- 1 - 



CFO 15056 US 



IMAGE PROCESSING APPARATUS , IMAGE PROCESSING 
METHOD, AND STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The invention relates to an image processing 
apparatus and an image processing method for performing 
a pixel density conversion of an image and to a storage 
medium . 

Related Background Art 

Hitherto, what is called a color original copying 
apparatus as shown in Fig. 10 has been known as a 
system for digitally reading a color original image and 
generating a copy image. 

In Fig. 10, reference numeral 1001 denotes an 
image scanner for reading an original and performing a 
digital signal process, and 1002 indicates a printer. 
An image corresponding to an original image read by the 
image scanner 1001 is printed and outputted onto a 
paper in a full color by the printer 1002. In the 
image scanner 1001 , reference numeral 1000 denotes a 
mirror surface pressure plate. An original 1004 put on 
a copyboard glass (hereinafter, referred to as a 
platen) 1003 is irradiated by lamps 1005 and an 
obtained image is guided to mirrors 1006, 1007, and 
1008. An image is formed by a lens 1009 onto a solid- 
state image pickup device sensor (hereinafter, referred 



to as CCD) 1010 of -three lines. Three image signals of 
red (R) , green (G), and blue (B) as full color 
information are sent to a signal process unit 1011. 
The lamps 1005 and mirror 1006 are mechanically moved 
in the direction perpendicular to the electric scanning 
(main-scan) direction of the line sensor at a speed v, 
and the mirrors 1007 and 1008 are mechanically moved in 
the direction perpendicular to the electric scanning 
(main-scan) direction of the line sensor at a speed 
(l/2)v, thereby scanning (sub-scan) the whole surface 
of the original. The original 1004 is read at a 
resolution of 600 dpi (dots/inch) in both main-scan and 
sub- scan. 

The signal process unit 1011 electrically 
processes the read image signal, separates it into 
color components of magenta (M) , cyan (C), yellow (Y), 
and black (Bk), and sends them to the printer 1002. A 
color component of one of M, C, Y, and Bk is sent to 
the printer 1002 with respect to one scan of the 
original in the image scanner 1001 . One print-out 
operation is completed by scanning the original four 
times in total. 

Pixel signals of M, C, Y, and Bk sent from the 
image scanner 1001 are transmitted to a laser driver 
1012. The laser driver 1012 modulates a semiconductor 
laser 1013 in accordance with the transmitted image 
signals. A laser beam scans the surface of a 
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photosensitive drum 1017 -through a polygon mirror 1014, 
an f-e lens 1015, and a mirror 1016. Image data is 
written at a resolution of 600 dpi (dots/inch) in both 
main- scan and sub- scan in a manner similar to the 
5 reading mode. 

Reference numeral 1018 denotes a rotary developer 
comprising a magenta development unit 1019, a cyan 
development unit 1020, a yellow development unit 1021, 
^ and a black development unit 1022. The four 

10 development units are alternately come into contact 
jtt with the photosensitive drum 1017, thereby developing 

!i? an electrostatic latent image formed on the 

13 

^ photosensitive drum by toners. 

H Reference numeral 1023 denotes a transfer drum. 

; 'iji 

01 15 The paper which is fed from a sheet cassette 1024 or 

1025 is wound around the transfer drum 1023, thereby 
transferring the images developed on the photosensitive 
drum onto the paper. 

After the images of four colors of M, C, Y, and Bk 
20 were sequentially transferred as mentioned above, the 

paper passes through a fixing unit 1026, the toners are 
fixed onto the paper, and thereafter, the paper is 
delivered. 

According to the conventional example as described 
25 above, it is fundamentally necessary that the image 
scanner for reading the original and the printer for 
outputting a copy image synchronously operate. That 



is, the image signals of R, G, and B read by -the CCD 
sensor are processed every pixel by the signal process 
unit, converted into image signals of M, C, Y, and Bk, 
successively sent to the printer, and written onto the 
photosensitive drum by the laser beam, thereby forming 
the copy image. 

In the conventional example, one of M, C, Y, and 
Bk is used for forming the image and the image forming 
process is repeated with respect to each color, so that 
the original is continuously read four times. 

It is not always necessary to continuously perform 
the reading operation of the original four times but 
there is also a construction such that the image data 
which was read only once is stored in temporary storing 
means and the stored image data is read out and 
outputted synchronously with the image formation of 
each of M, C, Y, and Bk. 

However, although there is no need to store the 
image data into the storing means in the former 
construction, the scanner and printer need to 
simultaneously operate. Therefore, for example, in the 
case where a heating unit of the fixing unit (in case 
of an ordinary thermal fixing type) of the printer is 
not sufficiently heated, since the printer is in a 
standby mode, the copying operation and the original 
reading operation cannot be performed. 

In case of copying a plurality of copies of each 
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of a plurality of originals, it is necessary to perform 
the operation for reading one original plural times in 
correspondence to the output of a plurality of copies. 
The reading operation has to be performed with respect 
5 to each of a plurality of originals. Thus, a time 

which the user has to expend for such a purpose is very 
long. 

In the latter construction, the scanner and 
;S printer can perform the original reading operation 

i4 lO asynchronously and, also in case of outputting a 

plurality of copies, it is sufficient to perform the 
;£ original reading operation once per original. However, 

^L. since an amount of image data to be stored in the 

storing means is extremely large, it is difficult to 

ill 

J 1 15 simultaneously store a plurality of original images. 

Therefore, if it is intended to read a plurality of 
original images in a lump and realize an exchange of 
pages, a synthesis output of a plurality of original 
images, or the like after completion of the reading 
20 operation, a storage device of a very large capacity is 
needed and it is not practical. It is also impossible 
to perform a layout synthesis by enlargement and 
reduction of the stored image data. 

In the case where it is intended to perform the 
25 optimum process in consideration of a feature of the 
image data, it is necessary to detect the feature of 
the image. A point of making handling of the image 
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easy and outputting -the image of a high quality in case 
of performing the layout synthesis by the enlargement 
and reduction in the process using the feature data is 
not sufficiently examined. 

5 

SUMMARY OF THE INVENTION 

It is an object of the invention to provide an 
image processing apparatus and its control method, in 
•J which the above problems can be solved. 

10 Another object o£ the invention is to provide an 

^ image processing apparatus and its control method, in 

^ which an image output of a high quality can be 

outputted while reducing a memory capacity of an image. 
M Still another object of the invention is to 

yl 15 provide an image processing apparatus and its control 

ul method, in which the same image processes can be 

performed for a copy of an original image and an image 
output of data from a computer. 

Further another object of the invention is to 
20 provide an image processing apparatus and its control 
method, in which proper image processes can be 
performed for each of parts constructing an image and 
an image output of a high quality can be performed. 

The above and other objects and features of the 
25 present invention will become apparent from the 

following detailed description and the appended claims 
with reference to the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a schematic 
construction of an image processing apparatus to which 
the invention can be applied; 
5 Fig. 2 is a diagram showing an example of an 

original image; 

Fig. 3 is a diagram for explaining an example of 
an image area dividing process; 

Figs. 4A, 4B, and 4C are diagrams for explaining 
10 an example of flag data; 

Fig. 5 is a diagram for explaining an example of a 
layout synthesis output; 

Fig. 6 is a block diagram showing an example of an 
output image processing construction; 
15 Figs. 7A, 7B, 7C, and 7D are diagrams for 

explaining an example of a pixel density converting 
method ; 

Fig, 8 is a diagram for explaining an example of a 
process in a 2-dimension of the pixel density 
20 converting method; 

Figs. 9A and 9B are diagrams for explaining an 
example of an offset process in the pixel density 
converting method; 

Fig. 10 is a diagram for explaining a conventional 
25 color image copying apparatus; and 

Fig, 11 is a block diagram showing a schematic 
construction of an image processing apparatus to which 
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the invention can be applied. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
<First embodinient> 
5 An embodiment of the invention will now be 

described hereinbelow with reference to the drawings. 

Fig. 1 is a block diagram showing an example of a 
construction of a copying apparatus of the first 
embodiment . 

10 (Reading unit) 

An original to be copied is put on a copyboard 
glass (corresponding to 1003 in Fig. 10) of a scanner 
101 and read. As shown in Fig. 10, the scanner 
digitally reads an image of the original every pixel by 

15 a 3 -line color CCD and transfers color image signals to 
an input image process unit 102. In the input image 
process unit 102, well-known image processes such as 
shading correction, CCD inter-line correction, color 
correction, and the like are performed to the RGB color 

20 image signals sent from the scanner. 

Reference numeral 103 denotes a block for 
performing an image area dividing process to the image 
processed color image signals which are outputted from 
the input image process unit 102. This block is an 

25 image area division process unit for detecting a 

feature of an image such as photograph area, character 
area, mesh area, or the like every pixel of the input 
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image and generating flag data indicative of attributes 
of each image area* 

( Image area dividing process ) 

The image area division process unit will now be 
5 described. The image area dividing process is 

performed for extracting a feature of the original 
image in order to perform optimum image processes in 
accordance with the feature of the image included in 
the original image and generating a signal showing the 

10 image area attributes (hereinafter, such a signal is 

referred to as flag data). For example, various image 
areas such as full color photograph area of continuous 
gradation, character area of monochromatic color of 
black, mesh print area like a newspaper print, and the 

15 like exist mixedly in the original. If those image 
areas are uniformly processed by a same image 
processing procedure and resultant data is outputted, a 
preferable picture quality cannot be obtained in many 
cases. To solve such a problem, therefore, in the 

20 first embodiment, Fig. 2 shows a specific procedure for 

detecting attributes of the image data included in the 
original image by using the color image signals 
processed by the input image process unit 102 and 
generating flag data for identifying the detected 

25 attributes. 

Fig. 2 shows an example of an original image and 
illustrates a state where a silver salt photograph area 



- 10 - 



202, a black character area 203, a mesh print area 204 , 
and a color graphic area 205 exist mixedly in one page 
201* The scanner scans the original image by the color 
CCD sensor and reads it as color digital signals (R, G, 
B) of each pixel. The read RGB signals have a feature 
which is determined in dependence on the attributes of 
each area of the image. If the G signal among signal 
values (R, Q, B) read by the CCD sensor in each area is 
plotted in the pixel arranging direction of the CCD, 
for example, a diagram as shown in Fig. 3 is obtained. 
In Fig. 3, reference numerals 302, 303, 304, and 305 
denote examples of characteristics which 
characteristically appear in the case where the areas 
202 to 205 in Fig. 2 are read. An axis of abscissa 
denotes a pixel position in the pixel arranging 
direction of the CCD and an axis of ordinate indicates 
the read signal value. As the value approaches upward, 
the nearer the pixel approaches white (bright). 

The feature of each area will be described. In 
case of the silver salt photograph area 202, the change 
302 in image signal depending on the reading position 
is relatively gentle and a difference 312 of the pixel 
values of the pixels existing at a short distance is 
small. Reference numeral 303 denotes the 
Characteristics of the black character area 203. Since 
black characters are written on a white background, a 
plot of its signal value shows characteristics such 
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that the read signal value suddenly changes in a range 
from a white background portion 313 to a character 
portion 323. Reference numeral 304 denotes the 
characteristics of the mesh area 204. In case of the 
5 mesh area, since the white background 314 and a mesh 

324 printed thereon are repeated, a plot of the signal 
value shows characteristics such that black and white 
are repeated at a high frequency as shown in the 
? J diagram. Reference numeral 305 denotes the plot 

2f 10 diagram of a graphic area. In an edge portion 315 of 

JO graphic, the signal value suddenly decreases and an 

MJ internal coloring portion 325 indicates characteristics 

5i such that a predetermined intermediate level continues. 

M To discriminate the above attributes, it is 

If! 15 sufficient to detect the feature of each area as 

lI described above from the read signal values and 

discriminate. For this purpose, it is possible to use 
a feature extracting method using a well-known method 
based on a change amount of the image data near a 
20 target pixel, an accumulation value of the change 

amount in a predetermined interval, a luminance value 
(white background or a colored background) of a 
peripheral pixel, the number of times of change from 
white to black of the image data in a predetermined 
25 interval, or the like and to use a well-known attribute 
discriminating method based on the feature extracting 
method . 
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Figs. 4A to 4C show an example of attribute flags 
formed for the original image of Fig. 2 as mentioned 
above. Although three kinds of flags of a character 
flag, a figure flag, and a mesh flag are formed here as 
5 attribute flags (flag data), the invention is not 

limited to them. Fig. 4A shows the character flag. A 
pixel shown in black in the diagram is a pixel having a 
character attribute, a character flag = 1 is formed, 
and the other area is set to a character flag = 0 

10 (white portion in the diagram). Fig. 4B shows the 

figure flag corresponding to an area where it is set to 
1 in the graphic area and to 0 in the other area. Fig. 
4C shows the mesh flag corresponding to an area where 
it is set to 1 in the mesh area and to 0 in the other 

15 area. 

Since the silver salt photograph area 202 does not 
correspond to any of those areas, all flags are set to 
0 and it does not appear in Figs. 4A to 4C. 

If the image attributes are detected every pixel 

20 by the above image area dividing processes, image 
processes according to the image attributes are 
subsequently executed by a second input image process 
unit 104. In the unit 104, for example, a process to 
emphasize a sharpness of characters by emphasizing a 

25 high frequency component of the image can be performed 
to the character area, a process to remove a moire 
component that is peculiar to the digital image by 
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performing what is called a low pass filter process can 
be performed to the mesh area, or the like. Those 
processes can be switched on a pixel unit basis in 
accordance with the attribute flag data generated by 
5 the image area division process block 103. 
(Storage of image data) 

The image data which was read by the scanner and 
subjected to the various input image processes and the 
attribute flag data formed by the above procedure are 

10 temporarily stored in a first image memory 105 and a 

first flag memory 106 , respectively. In this instance, 
the image data and the attribute flag data are stored 
as partial images as much as a whole image of one page 
of the original or as much as a predetermined size of 

15 one page* 

The image data and attribute flag data which have 
temporarily been stored are compressed by a data 
compression unit 109 and stored in a storage device 
110. It is desirable that the storage device 110 is a 

20 storage medium such as a semiconductor storage medium 
which can be accessed at a high speed. In the data 
compression unit 109, different data compressing 
processes are performed to the image data and the flag 
data, respectively. That is, it is desirable that a 

25 high efficient compressing process such as a JPEG 

compression such as to make deterioration of the image 
inconspicuous is performed to the image data in 
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consideration of "the human visual characteristics 
although such a process is irreversible. On the other 
hand, it is preferable to use a reversible compression 
system such as a JBIG compression to the flag data 
5 because a dropout or change of the attribute flag 

information does not occur. The reduction of a data 
amount using the proper compressing method according to 
the kind of data can be realized by such a 
construction. In this manner, the image data and flag 

10 data to which the different compressing processes have 
been performed are stored in the storage device 110 on 
a page unit basis of the original. There is also a 
case where the stored data is written into an auxiliary 
storage device 111. As an auxiliary storage device 

15 111, it is preferable to use a medium such as a hard 

disk which can store a large amount of data although a 
recording speed is slightly low. As mentioned above, 
by using the auxiliary storage device 111 such as a 
hard disk in addition to the storage device 110, the 

20 original images of a number of pages can be efficiently 
stored and accumulated. 
(Reading of image data) 

The image data and attribute flag data stored in 
the storage device 110 or auxiliary storage device 111 

25 are read out in order to output them from a printer 
117, the compression data is decompressed by a data 
decompression unit 112, and they are written into a 
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second image memory 114 and a second flag memory 115, 
respectively. At: -this time, -there is a case where 
pixel densities of the stored image data are converted 
in pixel density conversion units 113a and 113b. Such 
5 a pixel density conversion is used, for example, in the 
case where the user wants to enlarge or reduce the 
stored image data and print it out or the case where 
the user wants to layout -synthesize images of a 
plurality of stored pages onto one sheet of print 

10 output paper and output them as one paper. 

As an example of the synthesis output of a 
plurality of pages, there is a case as shown in Fig. 5. 
That is, it is assumed that two original images 501 and 
502 have previously been stored in the storage device 

15 110. Fig. 5 relates to a case where those two sheets 
of images are synthesized onto one output paper of the 
same size as that of the original, thereby obtaining a 
print output as shown at 503. For this purpose, the 
stored image data 501 is first read out from the 

20 storage device 110 and the compressed data is 

decompressed. The decompressed data is reduced at a 
predetermined magnification by the first pixel density 
conversion unit 113a, rotated counterclockwise by 90° 
by a rotation process unit (not shown), and written 

25 into a predetermined area in the second image memory 
114 (area corresponding to 504 in Fig. 5). 

Subsequently, the image data 502 is read out from 
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-the storage device 110 and similarly subjected to 
decompression, resolution conversion, and rotating 
process. The resultant data is written into an area 
corresponding to 505 in the second image memory 114. 
In this instance, flag data corresponding to originals 
A and B are also similarly subjected to decompression, 
resolution conversion, and rotating process (the same 
magnification and the same rotating process as those 
for the image data). The resultant data is written 
into a corresponding area in the second flag memory 
115. However, a pixel density converting process 
(reducing process) in this case is executed by the 
second pixel density conversion unit 113b. Since the 
image data is similarly zoomed and rotated with respect 
to the corresponding flag data, even in case of 
performing a layout print, adaptive image processes, 
which will be explained hereinlater, according to the 
flag data can be performed. It is desirable to use 
different methods for the pixel density conversion of 
the image data and the pixel density conversion of the 
flag data. For example, a well-known method such as 
linear interpolating method, bicubic spline 
interpolating method, or the like can be used for the 
image data. For the pixel density conversion of the 
flag data, it is desirable to use a pixel density 
converting method such as a nearest neighborhood 
processing method or the like that is adapted to binary 
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data. The details will be explained hereinlater. 
(Output of image data) 

When the image data and flag data temporarily 
stored in the second image memory 114 and second flag 
memory 115 reach a predetermined size, they are 
transferred to an output image process unit 116. The 
output image process unit 116 executes well-known image 
processes for print outputting the RGB image data, 
namely, a luminance density conversion, an RGB -> CMYK 
conversion, a gamma correction, a binarizing process, 
and the like and transfers the processed data to the 
printer 117. On the basis of the transferred image 
signals of CMYK, the printer 117 drives the 
semiconductor laser, and forms and outputs a visible 
image onto the transfer paper by a well-known 
procedure. 

The flag data stored in the second flag memory 115 
is used for switching the processes which are executed 
in the output image process unit 116. That is, by 
making masking coefficients of the RGB -* CMYK 
conversion different in the photograph area and the 
character area, a picture quality of the output image 
can be improved. For example, conversion coefficients 
such that black characters can be reconstructed only by 
the black toner (that is, in the case where the image 
data is achromatic color, coefficients such that C, M, 
Y = 0) are applied to the pixels in the character area, 
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namely, the character flag = 1. Coefficients such that 
even in case of the achromatic color, C, M, Y * 0 and 
deep black can be reconstructed can be applied to the 
other area. 

In the binarizing process, the C, M, Y, and K 
signals are converted into binary signals of 0 or 1 by 
using a well-known error diffusion process or dither 
process. However, since priority is given to a 
sharpness of an output image in the character area or 
graphic area at this time, the error diffusion process 
is applied. Since importance is attached to a 
gradation in the photograph or mesh area, the dither 
process is applied- By switching the contents of the 
binarizing process in accordance with the attribute 
flag data in this manner, the picture quality of the 
output image can be improved. 

Fig. 6 shows an example of a constructional block 
diagram for such processes. The second image memory 
114, second flag memory 115, and printer 117 are the 
same as those in Fig. 1. The color image data of RGB 
read out from the second image memory 114 is inputted 
in parallel to RGB -» CMYK converting circuits 601 and 
602 and independently converted into the CMYK image 
signals, respectively. One of outputs of the CMYK 
converting circuits 601 and 602 is selected by a first 
selector 603 in accordance with a flag signal in the 
second flag memory 115. If conversion coefficients for 



the character area have been set in the CMYK converting 
circuit 601 and coefficients other than the conversion 
coefficients for the character area have been set in 
the CMYK converting circuit 602, the output of the CMYK 
converting circuit 601 is selected when the character 
flag in the second flag memory 115 is equal to 1. The 
output of the CMYK converting circuit 602 is selected 
when the character flag = 0. 

An output of the first selector 603 is also 
separated in parallel into two systems. One of them 
passes through a first gamma correction circuit 604 and 
an error diffusion binarization process unit 606 and is 
inputted as a binary CMYK signal to a second selector 
608. The output of the first selector 603 also passes 
through a second gamma correction circuit 605 and a 
dither process binarizing circuit 607 and is also 
inputted as a binary CMYK signal to the second selector 
608 . 

The second selector 608 selects an output of 
either the error diffusion process unit 606 or dither 
process unit 607 and transfers it "bo "the printer 117. 
Since the error diffusion process is selected for the 
character area and flag area here, when the character 
flag = 1 or figure flag = 1, the second selector 608 
selects the output of the error diffusion process unit 
606* In the other cases, the second selector selects 
the output of the dither process unit 607. 
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(Pixel density conversion of image data) 

The above pixel density converting method will be 
described in detail. Explanation will now be made with 
respect to a processing method in the case where the 
image data and flag data which were decompressed by the 
data decompression unit 112 are enlarged or reduced by 
the pixel density conversion units 113a and 113b and 
output ted to the second image memory 114 and second 
flag memory 115. 

Figs. 7A and 7B are graphs obtained by plotting 
the image data and flag data which were read, 
respectively. An axis of abscissa denotes a pixel 
position (coordinate) in the arranging direction of the 
CCD in the image reader and an axis of ordinate 
indicates a pixel value (0 to 255) and a flag value (0 
or 1) of the image, respectively. Fig. 7A shows, for 
example, the G signal among the R, G, and B signals. 
Fig. 7B shows, for example, the character flag among a 
plurality of flag data. 

In the diagram, white circles 701 and 702 indicate 
data of one pixel, respectively. In the embodiment, 
since a reading resolution of the image reader is equal 
to 600 dpi, an interval between the respective pixels 
corresponds to 600 dpi (25.4/600 mm) as a value on the 
original . 

A case of reducing such image data into, for 
example, 0.75 time will now be considered. (This 
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magnification corresponds to a reduction ratio in the 
example of Fig- 5). In this case, it is necessary to 
newly form pixel values at the positions shown by 
arrows of broken lines in the diagram and form the 
image data after the reduction. This process 
corresponds to the process for reducing and thinning 
out three pixels of the original image data and forming 
data of two pixels. Therefore, if the coordinate after 
the reduction arrives at a position 703, it is 
sufficient to set the original image data to the pixel 
values of the image after the reduction as they are. 
However, when it reaches positions 704, it is necessary 
to perform an interpolating arithmetic operation and 
form the data from the pixel values before and after 
the target pixel. If the linear interpolating method 
is used for this purpose, the pixel values after the 
reduction become as shown by black circles in Fig. 7C . 
Since each pixel value 705 in the diagram corresponds 
to the coordinate position 703, it is nothing but the 
pixel value of the inherent corresponding coordinate. 
However, since each pixel value 706 corresponds to the 
coordinate 704, it is replaced with a mean value of two 
adjacent pixels of the original pixel values 
sandwiching the position of 704. 

The above processes are executed by the first 
pixel density conversion unit 113a. 

A reducing process of the flag data will now be 
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described. Since the resolution of the flag data is 
equal to that of the image data, Fig. 7B shows the same 
pixel arrangement as that of Fig. 7A. The pixel 
coordinate corresponding to the reduced data in case of 
reducing the data into 0.75 time is set to a position 
shown by an arrow of a broken line even in Fig. 7B in a 
manner similar to Fig. 7A. Therefore , although a pixel 
value 709 corresponding to a coordinate 707 is nothing 
but the pixel value of the inherent corresponding 
coordinate in Fig. 7B, it is necessary to 
arithmetically operate a pixel value 710 corresponding 
to a coordinate 708 from the neighboring pixel values 
(flag values) on both sides of the pixel value 710 and 
form it. 

However, since the flag data in Fig. 7B is binary 
information of 0 or 1, the foregoing linear 
interpolating method cannot be applied. Therefore, it 
is sufficient to use here a construction such that the 
pixel value (flag value) existing at the nearest 
distance position among the original image coordinates 
corresponding to the pixel positions after the 
reduction is used as a pixel value after the reduction. 
This method is called a nearest neighborhood reducing 
process. 

However, if such a method is simply used, it will 
be understood that the pixel value corresponding to a 
pixel 711 of "1" in Fig. 7B is changed to the pixel 



- 23 - 



value 710 in Fig. 7D after completion of the conversion 
and has been extinguished. Therefore, it is assumed 
that a processing method whereby the OR obtained by the 
neighboring flag values on both sides of the pixel 
position after the reduction is set to the flag value 
after the reduction is used. By using this method, the 
pixel value after the reduction becomes as shown at 712 
and a situation such that the inherent flag information 
before the reduction is dropped out by the reducing 
process can be prevented. 

The above processes are executed by the second 
pixel density conversion unit 113b. 

If the reduction image data and reduction flag 
data formed as mentioned above are stored in the second 
image memory 114 and second flag memory 115, a print 
output reduced by the procedure described above can be 
obtained. 

Although the explanation has been made here on the 
assumption that the image data and flag data are 
arranged as a one-dimensional array, the linear zooming 
method can expand the image data to the 2-dimensional 
data as is well known. A zooming process of the flag 
data can be also expanded to a 2-dimension. Fig. 8 is 
a diagram for explaining a case where the zooming 
method of the flag data has been expanded into the 2- 
dimension. In the diagram, data shown by a white 
circle 801 indicates flag data of the original image 
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before the zoom and has a value of 0 or 1. A black 
circle 802 indicates a position of a pixel to be formed 
after the zoom (reduction in this case) and the data 
shown by the black circle also has a value of 0 or 1. 
5 Now, assuming that a position of the target pixel is 
located at 803, flag data after the zoom 803 can be 
obtained by getting the OR by using all of four 
original image flag data 804 surrounding the target 
pixel 803. That is, 0 is formed as a target pixel if 

10 all of the four pixels shown at 804 are equal to 0, and 
1 is formed in the other cases. 

Although the explanation has been made on the 
assumption that the pixel values after the zoom are 
formed by the OR process of the near pixels, the 

15 invention is not limited to such a case. For example, 
there are considered various methods such as method 
whereby only one nearest pixel is detected and set to 
the same value as that of the target pixel, method 
whereby the number of pixels of "1" among the 

20 peripheral near pixels is counted and, if a count value 
is equal to or larger than a predetermined value, the 
pixel value after the zoom is set to 1, and the like. 

The forming (generating) method of the pixel value 
can be also changed after the zoom in accordance with a 

25 zoom ratio. For example, it is also possible to 
perform processes such that if the zoom ratio is 
smaller than 1 (reduction), the target pixel value is 
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formed by the OR of a plurality of pixels near the 
target pixel, and if the zoom ratio is larger than 1 
( enlargement ) , the pixel value of one pixel existing at 
the nearest position of the target pixel is formed as a 
5 target pixel value as it is. 

The forming method of the pixel value can be also 
changed after the zoom in accordance with attributes of 
the flag. Although three kinds of flags of the 
£=f character attribute, figure attribute, and mesh 

M 10 attribute have been shown in the embodiment, there is 

\Q also a case where a discrimination result about whether 

yj the OR process is suitable or the replacement to only 

S( one near pixel is suitable upon reduction differs every 

Q. attribute. Therefore, for example, if the character 

S 15 flag and figure flag are reduced by the OR process and 

rf the mesh flag is reduced by the process for replacing 

the target pixel value with the nearest neighboring 
pixel value, an effect such that an error decision flag 
in the case where a mesh decision precision is not 
20 enough is eliminated upon reducing process can be 

expected. If a method whereby the number of pixels 
whose flag data is equal to 1 among the peripheral 
neighboring pixels is counted and if a count value is 
equal to or larger than a predetermined value, the 
25 pixel after the zoom is set to 1 is used for the mesh 
flag, even if the mesh flag is erroneously equal to 1 
in a region out of the mesh area in the erroneous 



- 26 - 



discrimination, since no mesh flag exists at positions 
around -the -target pixel, the count value is not equal 
to the predetermined value or more and the influence by 
the erroneous decision can be eliminated. 
5 It is also possible to use a construction such 

that a manual switching unit for switching the 
interpolating method of the flag data and a sampling 
instructing unit for allowing a sampling print 
(thumbnail print) to be outputted are provided for the 

10 operation unit, the actual print is executed in 

response to a sampling output instruction, and the 
operator is allowed to select the interpolating method 
by a manual instruction. Further, it is also possible 
to execute a process such that an offset is given to 

15 sampling coordinates in the pixel density conversion. 

Figs. 9A and 9B are diagrams for explaining processes 
in such a case. 

Fig. 9A is a diagram for explaining a pixel 
density conversion of image data in a manner similar to 

20 that in Fig. 7A. A start position shown by an arrow 

corresponding to the pixel position after completion of 
the pixel density conversion has been shifted by Ax as 
shown at 903. An interval between the arrows is the 
same as that shown in Figs. 7A to 7D. 

25 By using the above method, a situation such that 

the case where the inherent pixel value is outputted as 
it is and the case where the original pixel values are 
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interpolated and outputted alternately occur is 
eliminated and all output pixel values are formed by 
interpolation arithmetic operations between the 
neighboring adjacent pixels, so that there is a case 
5 where the picture quality is improved. 

As mentioned above, in the case where the offset 
has been given to the sampling position by the first 
pixel density conversion unit, it is necessary to also 
set the same offset value AX to the second pixel 
10 density conversion unit. Such a state is shown in Fig. 
9B. A start position 907 of the output pixel position 
is shifted by AX in a manner similar to the case of 
Fig. 9A. 

Since a distance relation between the output pixel 
15 position and the original pixel position is deviated in 
this case, the adjacent pixels on both sides to be 
subjected to the OR calculation are different from 
those in Figs. 7A to 7D and the corresponding position 
relation between the pixel after the pixel density 
20 conversion of the image data and the pixel after the 

pixel density conversion of the flag data is preferably 
held. 

(Another embodiment) 

Although a flow of the image data from the scanner 
25 101 in Fig. 1 has been described above, the processes 
in the first embodiment can be also similarly applied 
to image data which is inputted from an external 
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communication path 119 through a communication 
interface 118, 

As -typical data which is sent from the external 
communication path 119, there is image data described 
by what is called PDL (page description language). The 
PDL data which is inputted here is a group of commands 
describing an image. If PDL data is interpreted and 
converted into bit map data similar to the scanner read 
image, it can be applied as it is. 

That is, the PDL data inputted from the 
communication I/F 118 is converted into an intermediate 
language format called a display list by an interpreter 
108. The display list is sent to an RIP (raster image 
processor) 107 and developed into bit map data. The 
developed image data is stored in the first image 
memory 105. At this time, the RIP 107 forms attribute 
information of the image data which was rasterized 
simultaneously with it as flag data and stores it into 
the first flag memory 106. 

In this instance, the process for forming the flag 
data by an image area dividing process with reference 
to the image data as described in the first embodiment 
is unnecessary here. It is sufficient to form the flag 
data of the corresponding pixel of the rasterized image 
with reference to the attribute information 
(information indicative of a photograph, characters, 
graphics, or the like) held every part in the PDL data 
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which is input-ted "to the RIP. 

That is, if a PDL command to form character parts 
is inputted to the RIP 107 , it is sufficient that the 
RIP 107 forms a bit map image of the character data 
and, at the same time, forms the character flag (= 1) 
as flag data corresponding to the area where the 
character has been formed. If the image data and flag 
data were formed as mentioned above, the subsequent 
processes can be executed in substantially the same 
manner as those in the first embodiment. 

Although two pixel density conversion units have 
been provided in Fig. 1, the pixel density conversion 
can be also performed in one pixel density conversion 
unit as shown in Fig. 11. 
(Other embodiments of the invention) 

A processing method whereby a program for making 
the construction of the above embodiment operative so 
as to realize the functions of the embodiment mentioned 
above is stored in a storage medium, the program stored 
in the storage medium is read out as codes, and 
operations are executed by a computer in accordance 
with the read-out program codes is also incorporated in 
the purview of the foregoing embodiment. The storage 
medium in which the program has been stored is also 
incorporated in the embodiment. 

As such a storage medium, for example, a floppy 
disk, a hard disk, an optical disk, a magnetooptic 
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disk, a CD-ROM, a magnetic tape, a non-volatile memory 
card, or an ROM can be also used. 

The invention is not limited to the example in 
which the processes are executed by the sole program 
stored in the storage medium but a case where the 
program operates on the OS in cooperation with another 
software and functions of an expansion board and the 
operations of the embodiment are executed is also 
incorporated in the purview of the foregoing 
embodiment . 

As described above, a data output which makes the 
handling of the image easy and enables a high quality 
image output -to be performed without bearing a heavy 
load on the user can be performed, and the image can be 
formed at an arbitrary zoom ratio. An image memory 
capacity can be also suitably determined in accordance 
with the kind of data to be stored. Further, the pixel 
density converting process can be also adaptively 
performed and the improvement of the picture quality 
can be also realized. 

The same processes can be performed in both case 
where the original image is read by the scanner and a 
print is outputted and case where a print image using 
-the PDL (page description language) is outputted. The 
optimum image processes can be performed to individual 
parts constructing the image at an arbitrary zoom 
ratio. An output image of a high picture quality can 



- 31 - 



be obtained in any case. 

The present invention is not limited to the 
foregoing embodiments but many modifications and 
variations are possible within the spirit and scope of 
5 the appended claims of the invention. 



